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Abstract 



We report a new optimal resolution for the statistical stratification problem under 
proportional sampling allocation among strata. Consider a finite population of N 
units, a random sample of n units selected from this population and a number L of 
strata. Thus, we have to define which units belong to each stratum so as to minimize 
the variance of a total estimator for one desired variable of interest in each stratum, 
and consequently reduce the overall variance for such quantity. In order to solve this 
problem, an exact algorithm based on the concept of minimal path in a graph is 
proposed and assessed. Computational results using real data from IBGE (Brazilian 
Central Statistical Office) are provided. 
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1 Introduction 



A common procedure in sampling surveys is partitioning the elements of a 
population, before distributing the sample on it, in such a way to obtain most 
useful information from the data to be collected. This procedure is called 
stratification. It may have different aims, such as to guarantee obtaining in- 
formation for some or all the geopolitical regions of a country, or to provide 
more precision in estimating population quantities by identifying strata with 
more homogeneous elements into them, according to one or more variables. In 
this latter case, the stratification is also called statistical stratification. 

A principal use of statistical stratification, in order to obtain a better precision, 
is in defining what percentage of the sample must be taken from each stratum 
once we have chosen a non-uniform allocation scheme, that is, a non-trivial 
functional relation between the size of each stratum and the number of sample 
units to be collected in it. Thus, it is important to consider the allocation 
scheme itself in order to do a suitable statistical stratification. 

In this paper, we propose an exact algorithm to solve the statistical stratifica- 
tion problem, that we call simply stratification problem, considering a simple 
non-uniform allocation scheme. Specifically, this method intends to solve the 
problem of optimal stratification with stratified simple random sampling with- 
out replacement [3] using proportional allocation. In this problem, we must 
divide a population of size N into L strata considering an auxiliary variable 
X, also called the size variable, whose values are known for all units in the 
population. The first stratum is defined as the set of units in the population 
whose X values are lower than or equal to a constant value b\ , the second 
one as the set of units whose X values are greater than b\ and lower than or 
equal to 62 and so on. Based on this definition the stratum h (h — 2, L — 1) 
is defined as the set of units in population with values of X belonging to the 
interval (bh-i, bh], where b\ < b<i < ... < bi-i are the boundaries of each stra- 
tum, and the stratum L corresponds to the set of observations which values 
are greater than The problem of optimal stratification consists in to find 
boundaries b\ < 62 < •■■ < < ... < b^-\ which minimize the variance of the 
estimator of total for one or more variables Y of study that are supposed to 
have some correlation with the X variable, or even the X variable properly. 
Aiming to solve this problem, a new algorithm, when proportional allocation 
is used, is proposed using the idea of minimal path in graphs []]. 

This paper is organized in five sections. In section 2, we present some basic 
concepts about stratified simple random sampling. In section 3, we define the 
problem of stratification to be tackled in this work and offer a brief discussion 
about different approaches to this topic. We propose, in section 4, an algorithm 
based on Graph Theory in order to provide exact solutions to the stratification 
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problem defined in section 3. Finally, we present some computational results 
and considerations about the new algorithm. 



2 A Review of Stratified Simple Random Sampling 

In stratified sampling [3], a population with N units is divided into L groups 
with Ni, N 2 , N h , N L units respectively. These groups are called strata. 
There is no overlap among them and together they exhaust the population. 
Thus, we have 

N 1 + N 2 + ... + N h + ... + N L = N (1) 

After the strata definition, which is based on characteristics of the population, 
sampling units are selected in each sstratum, independently, according to a 
specific criteria of selection. The sample sizes of the strata are denoted by 
n 1 , n 2 , n h , n L , respectively. 

Some basic notation about stratified sampling is presented as follows. 

N - Number of units in the population ; 

Nh - Number of units in the stratum h ; 

n - Total sample size; 

ri/j - Sample size in the stratum h; 

Yhi - Value of a variable of interest Y for the unit i in the stratum h; 
Y \ = — 1 - Population mean of the variable Y in the stratum h; 
Y = J2h=i Nh-Yh - Population total of the variable Y; 

Si = ^' =1 i yfe ' — - Population variance of the variable Y in the stratum h; 



3 Problem Definition 

Consider a population U = {1,2, N} with a study variable Yu = {yi,y 2 , ■■■,Vn} 
and an auxiliary size variable Xu = {x\,x 2 , ...,xn}, x\ < x 2 < ... < x^ , to 
be used in the stratification process [3]. A sample is taken from U in order 
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to estimate the population total Y (where the symbol " stands for the 
estimated value of a population variable). 

Suppose that the population must be divided, taking into account the values 
Xu, into L disjoint groups, denoted by U±, U 2 , Uh, Ul- The union of these 
L groups correspond to the complete indexes of the population U\ U . . . U Ul = 
U. 

According to definitions in section 2, Nh is the total of units in the population 
in each stratum h, and nh is the number of sampling units to be selected in 
the population in each stratum h, h = 1, 2, L. Thus, the set of indexes Uh, 
where h — 1,2, L, contains the population indexes in each strata, such as: 
U 1 = {% : Xi < bi}] U h = {i : b h - X < x { < b h }, where h = 2,3, ...,L - 1 ; 
and Ul = {i ■ < Xi}, where b\ < b 2 < ... < bh < ••• < denote the 
boundaries of each stratum in the population. 

We must emphasize that repeated observations associated to the population 
vector Xu have to belong to the same stratum. 

Let the sample size rih and the population size Nh , defined in each stratum, 
considering certain variable of interest Y. The estimator [3] of the population 
total Y is defined as follows: 

? = E^EW* (2) 
h=i Uh k=i 



Then, the problem is to find strata boundaries bi < b 2 < ... < bh < ■■■ < 
bL-i that minimize the variance associated to the estimator of total Y , when 
simple random sampling without replacement in each stratum is adopted. The 
variance of Y is defined as follows: 

V(Y) = j:N h >.^.(l-^) (3) 



Notice that both Nh and S\ y are defined according the strata's boundaries 
while N is fixed previously. The sample sizes can be established using the 
following equations: 

2^1 = 1 N[.bly 



The equation @] is associated to proportional allocation and §5§ to Neyman's 
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allocation [3]. Replacing rih in <^fy by we have: 

n^ = £.(i-£)5> fc -si (6) 
/i=i 



We have to emphasize that to find a global minimum for the variance described 
in ([6]) considering proportional allocation or Neyman's allocation is a hard task 
to be done, either analytically or by intensive computing methods, because Sl y 
is a nonlinear function of b\ < 62 < ••• < and the number of possibilities 
of different choices for these values may be very high, as we shall see in section 
4. 

Because of that, several methods which yield a local minimum have been sug- 
gested. A well-known method of strata definition was proposed in pjjj. This 
method consists in approximating the distribution of the variable of strati- 
fication X in the population using an histogram with various classes, which 
implies in adopting the hypothesis that the variable of stratification has an 
uniform distribution [3] in each class. In this case, the problem of stratification 
has an ordinary solution when the Cumulative Root Frequency Algorithm, or 
Dalenius-Hodges rule, whose description can be find in [5] (chapter 5), is ap- 
plied. 

In recent studies, Lavalle and Hidiroglou ([?]) adopted a sample design using 
power allocation. The method aims to find stratification boundaries establish- 
ing the number of strata and the desired level of precision to minimize the 
overall sample size n. 

According to Hedlin [6], the strata delimitation is considered such that the 
variance of the total estimator of a variable of interest, given by ([3]), has to 
be a minimum, considering n and L fixed previously and applying Neyman's 
allocation in each strata. 

Gunning and Horgan [5] developed an algorithm that is easier to be imple- 
mented which applies the general term of a geometric progression to establish 
the boundaries of the strata when skewed populations are considered. This 
algorithm considers the hypothesis that the coefficients of variation are equal 
for all strata. 

As we can observe, there are a number of methods applicable to the optimal 
stratification problem using Neyman or power allocation. However, at this mo- 
ment no previous algorithm was proposed considering proportional allocation. 
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4 Methodology 



In order to implement the new methodology, we had to modify the input data 
structure. Since the N observations X v are ordered ascendingly, it is possible 
to gather them, taking into account only their distinct values. We have K 
distinct values of Xu, gathered in a set Q = {q%, q 2 , • Qk}, which are the 
eligible boundaries to stratify the whole population. 

Consider, for example, N = 9, L = 2 and X v = (2,4,4,8,10,10,10,15,15). 
Then we have Q = (2,4,8,10,15) = (eft, g 2 , 93, 94, 9s) \Q\ = 5 = K and 
I = {1,2,3,4,5}, where I is the set of indexes associated to the elements of 
Q. 



Defining U x = {i\xi < q 3 ,Xi G Xu} and U 2 = {i\q 3 < x { < q 5 ,Xi G Xu}, we 
have the following results: 



Stratum 


Population Size 


Labels for each 


Observations 


Indexes of Set I 






Stratum 


ofXu 




1 


JVi =4 


Ux = {1,2,..., 4} 


{XX, ;,,XA} 


{1,2,3} 


2 


N 2 = 5 


U 2 = {5,...,9} 


{x 5 , ...,x g } 


{4,5} 



Table 1 



Example of stratification 

Analogously, for L strata and K boundaries , we have to find L — 1 boundaries 
qk from Q . Considering a finite population of size N, that will be divided in L 
strata, and the ordered values Xjj, we establish the sets Q and /. The solution 
for this problem will then consist of boundaries qk , selected from Q, or indexes 
i , selected from /, that give the minimum variance according to ([6]). 

The resolution of the problem above can be obtained by considering the enu- 
meration of all the possible divisions of the observations associated to the 
set J, that is, by evaluating the variances of all the solutions and taking out 
the solution with the lower variance. However, this procedure may take an 
excessively high computational time even for moderately high values of the 
number of observations of I and/or the number L of strata. In fact, deter- 
mining the number of solutions to be considered corresponds to the following 
combinatorial problem: 

Determine the number m of non-negative integer solutions of the equation 
zi + z 2 + ... + z h + ... + z q = r (7) 

In this equation, each Zh corresponds to the number of elements of / allocated 
in each stratum h, q corresponds to the number L of strata and rcorresponds 
to the total of elements in /. In accordance with the stratification problem, it 
is necessary to make a little modification in equation (JTj) in order to guarantee 
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that the number of population observations is greater than or equal to 2 in 
each stratum (z h > 2). 

Performing a change of variable — + 2, > 0, and considering q = L 
and r = |/|, the equation ([7j) can be rewritten as 

t 1 + t 2 + ... + t h + ... + t L = \I\-2L (8) 



It is easy to verify that the number of solutions of the equation ([8]) is given 
by: 



(L+ |/| 


-2L-1)! 


(1*1 




2L)\{L- 1)! 



Note that m increases very rapidly with L and |/|. For example, if \I\ = 100 
and L = 5 we will generate m = 3.049.501 solutions, and we will reach m = 
40.430.556.376 solutions if |/| = 1000 and L = 5. It is important to remark 
that, in the case of an exhaustive procedure, we will need to generate and also 
evaluate the variance (see equation [6]) for each one of these solutions. 

Then, trying to reduce the potentially high number of arithmetic operations 
needed to obtain the optimal solution using the exhaustive enumerating pro- 
cess, we will instead solve the optimal stratification problem with proportional 
allocation by applying an algorithm based on the concept of minimum path 
in graphs. 

Initially, we will translate the problem and its solution into a Graph Theory 
language [1], using the definitions of direct path and minimum path as follows. 

Let G = (V, A) a direct graph with \V\ nodes, \A\ arcs, and a cost cy associated 
with each arc (i, j) in G. 

Definition 1: A directed path in G is a directed walk without any repetition 
of nodes. In others words, a directed path has no backward arcs. The directed 
path is represented by a sequence of distinct nodes i\ — i 2 — ... — i w , where 
{h,i2, -,i w } e V. 

Definition 2: Consider two nodes i s and id of G. The minimal directed path 
between i s and id is a path whose sum of costs on the arcs in the path is 
minimal. 

In order to make a correspondence of G with (part of) the solutions for the 
stratification problem, we associate to each index of the set I (see the beginning 
of this section) the nodes of the graph G = (V, A), that means V = I. More- 
over, to each arc(i, j) E A we associate a cost cy given by —.(1 — jr).N h .Sl , 
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where S% y is the variance of the observations of Y that correspond to the ob- 
servations of X which are associated to the indexes {i, i + 1, i + 2, — 1} G I. 

Consequently, the values are also well defined for each arc (table 2). Each 
arc G A corresponds to the indexes {i, i + i + 2, ...,j — 1} G I ; because 
of that an extra node |/| + 1 has to be added to the set V. 

In general, once defined the graph G with its nodes and arcs, to resolve the 
problem of stratification will consist in finding a minimal path, from the node 
1 to node \I\ + 1, with exactly L arcs whose sum of costs Qj (variances) is a 
minimum. Thus, we must minimize equation (jH]) 

Taking into account these aspects and the fact that each stratum has to be 
defined by at least two observations (in order to avoid an indetermination 
when calculating S"l y ), we can establish the following rules so as to determine 
each arc into G: 

• The first stratum has to be defined by an arc which has a node i = 1 
and finishes at maximum in node j — \I\ + 1 — 2(L — 1). 

• The last stratum has to be defined by an arc (i,j) which begins at least at the 
node i = 2.L — 1 and finishes exactly at the node j = \I\ + 1 — 2(L — L) = \I\ + 1. 

• The intermediate strata h (1 < h < L) can be defined from the arcs(i, j), 
such that 2.h - 1 < i < 1 1\ - 1 - 2.(L - h) and i + 1 < j < \ I\ + 1 - 2.(L - h). 

• If j — i = 1 , the arc (i, j) does not exist and then its cost is defined as 

Cij = +oo 

Considering these rules, the total number of arcs in the first ( j - i ^ 1), last 
and intermediary strata are given respectively by: 

Ti = S,T L = S, T h = *P±!L, S=\I\-2L + 1 (10) 



Thus, the total T of arcs built for application of the minimum path algorithm 
is: 

T = T 1 + T L + (L- 2).T h = 2.S + (L - 2).(^±^) (11) 



In figure 1, we present a short example of a graph for a population where 
\X\ = 8 and |/| = 8 and for L = 3. In table 2, we have all the possible arcs 
of the graph G associated to the stratification problem, adopting the rules 
defined previously 
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Stratum h 


Node i 


Node j 


Arcs 


1 


1 


5 


{(1,2), (1,3),(1,4),(1,5)} 


2 


3 


7 


{(3,4),(3,5),(3,6),(3,7),(4,5),(4,6),(4,7),(5,6),(5,7)} 


3 


5 


9 


{(5,9), (6,9), (7,9), (8,9)} 



Table 2 



Arcs associated to the graph of figure 1 considering the rules of construction 




Fig. 1. Example of a graph associated with the stratification problem 

If we consider the sequence of arcs (path) denned by {(1, 4), (4, 7)e(7, 9)}, the 
first strata would be defined by the indexes from 1 to 3, the second would 
have the indexes from 4 to 6 and the third, the indexes 7 and 8. 

The example shown in figure 1 allows us to see the enumeration process of all 
paths from node ltoj = |/| + l = 9 containing L = 3 arcs. So, a search to 
find a minimal path associated to a minimal variance can be carried on by 
considering just these paths. 

In order to find such a minimum path, we applied an extended Dijkstra's 
shortest path algorithm QlJ and |2j). Dijkstra's algorithm finds shortest paths 
from the source node (vertex) s to all other nodes in a network (G) with 
nonnegative arc costs. The extended version of the Dijkstra's algorithm takes 
into account the constraint that the number of arcs in the minimal path is 
a defined value k. Therefore, to solve the optimal stratification problem, we 
adjust the Dijkstra's algorithm in such a way to find a minimal path with 
exactly L arcs. We call the resulting complete algorithm StratPath. 

In this algorithm, the input parameters are the number of strata, the size of 
the population, the sample size and the observations X and Y, if a variable 
of study is considered. 

Further details of the Dijkstra's algorithm and the Extended algorithm can be 
found in [1] and [2]. What is important to emphasize is that, once the extended 
version of Dijkstra's algorithm gives optimal results (the shortest path) and the 
procedure we developed enumerates all the possible paths associated with all 
the possible solutions of the optimal stratification problem with proportional 
allocation, the StratPath algorithm actually provides an optimal result. 
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Considering the application of the modified minimum path algorithm, the 
computational complexity associated to the resolution of this stratification 
problem stays in the order 

0(2.S + (L — 2).(^±^)) + 0(L 2 .(|/| + l) 2 ) (12) 

In this expression, the first term is associated with number of operations (equa- 
tion [TTT) performed to generate all the arcs of the graph associated to the 
problem, and the second term corresponds to the number of operations per- 
formed by the minimum path algorithm [2] in order to obtain the solution of 
the problem. 

5 Computational Results 

The algorithm Stratpath was implemented using C and Delphi language. The 
computational results reported in this section refer to a microcomputer IBM- 
PC with Pentium Processor IV (1.73 Ghz - Dual Core) and 1GB of memory. 

In order to assess the computational results provided by the algorithm pro- 
posed in this paper, consider three populations, extracted from PAM - Produgao 
Agricola Municipal (Municipal Agricultural Production), performed in 2005 
by IBGE (Brazilian Central Statistical Office), which all have skewed positive 
distributions. These populations are associated to the total area of harvest in 
cities in the states of Rio Grande do Sul (population 1), So Paulo (population 
2) and Minas Gerais (population 3), considering the corn crop. These official 
data can be obtained from the internet in the following site: 
(http://www.sidra.ibge.gov.br/bda/agric/). 

We work under the assumption that the values of a study variable Y are 
equal those of the stratification variable X. Many other authors draw on this 
assumption, as Dalenius and Hodges [4] , Hedlin [6] and Lavallee and Hidiroglou 
[7j, among others. 

In tables 3 and 4 it is possible to find results for L = 4 and 5 strata. These ta- 
bles present the values of the populations size, set |J|, coefficients of variation 

(CV = 100. \Jv(X)/X), associated to estimates of totals of X obtained by 
applying the StratPath algorithm for each population, considering the mini- 
mization of the variance associated to proportional allocation (equation [6]) . 

Moreover, they also present the population totals and the sample sizes in each 
strata and the CPU times in seconds. We must emphasize that these sample 
sizes were obtained by using the equation HI 
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Population N \I\ 


CPU 


CV 


Sizes 




Stratum 
















1 


2 


3 


4 




1 488 197 


4 


3.71 


Nh 


262 


168 


50 


8 










nh 


54 


34 


10 


2 




2 585 272 


8 


4.75 


Nh 


447 


104 


24 


10 










nh 


76 


18 


4 


2 




3 842 238 


7 


6.34 


Nh 


680 


130 


16 


16 










nh 


81 


15 


2 


2 




lable 6 


















Stratum Boundaries with P 


=4 and n= 


1 nn 
1UU 














Population N \I\ 


CPU 


cv 


Sizes 




Stratum 
















1 


2 


3 


4 


5 


1 488 197 


5 


3.32 


Nh 


245 


150 


74 


14 


5 








nh 


50 


31 


15 


3 


1 


2 585 272 


10 


3.88 


Nh 


405 


128 


31 


16 


5 








nh 


69 


22 


5 


3 


1 


3 842 238 


8 


4.94 


Nh 


633 


135 


43 


16 


15 








nh 


75 


16 


5 


2 


2 



Table 4 

Stratum Boundaries with L=5 and n=100 

In this paper, we presented an optimal algorithm for the problem of stratifi- 
cation by using the approach of minimal path in graphs. 



This algorithm guarantees optimal strata boundaries, considering the assess- 
ment of the variance of a total estimator and a proportional allocation in strata 
and simple random sampling without replacement. This work can be extended 
to sampling with replacement ignoring the finite population correction. 

As we can see from tables 3 and 4, CPU times were very low (up to 10 seconds), 
in such a way that the algorithm is hoped to run well even for reasonable 
greater instances. 

In a future work, we intend to present a new algorithm that provides suitable 
boundaries for populations considering Neyman's allocation and other sample 
designs. 
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